Facets of Entropy
نویسنده
چکیده
Constraints on the entropy function are of fundamental importance in information theory. For a long time, the polymatroidal axioms, or equivalently the nonnegativity of the Shannon information measures, are the only known constraints. Inequalities that are implied by nonnegativity of the Shannon information measures are categorically referred to as Shannontype inequalities. If the number of random variables is fixed, a Shannon-type inequality can in principle be verified by a software package known as ITIP. A non-Shannon-type inequality is a constraint on the entropy function which is not implied by the nonnegativity of the Shannon information measures. In the late 1990s, the discovery of a few such inequalities revealed that Shannon-type inequalities alone do not constitute a complete set of constraints on the entropy function. In the past decade or so, connections between the entropy function and a number of subjects in information sciences, mathematics, and physics have been established. These subjects include probability theory, network coding, combinatorics, group theory, Kolmogorov complexity, matrix theory, and quantum mechanics. This expository work is an attempt to present a picture for the many facets of the entropy function.1
منابع مشابه
Some Results on facets for linear inequality in 0-1 variables
The facet of Knapsack ploytope, i.e. convex hull of 0-1 points satisfying a given linear inequality has been presented in this current paper. Such type of facets plays an important role in set covering set partitioning, matroidal-intersection vertex- packing, generalized assignment and other combinatorial problems. Strong covers for facets of Knapsack ploytope has been developed in the first pa...
متن کاملبررسی ویژگیهای روانسنجی «پرسشنامه شخصیتی 5 عاملی نئو» (NEO-FFI)
The major aim of this research was to investigate psychometric properties of “NEO-Five Factor Inventory” (NEO-FFI). To this aim, after doing preliminary stages and resolving possible problems, the exploration of this scale was conducted in two studies: in the first study, in order to assess reliability using internal consistency, 604 undergraduate students of Tehran, Amirkabir and Shahed Univer...
متن کاملWork Facets Predicting Overall Job Satisfaction among Resident Doctors in Selected Teaching Hospitals in Southern Nigeria: A Minnesota Satisfaction Questionnaire Survey
Background: Job satisfaction could be assessed using the single-item global approach or the multidimensional approach. This study aims to assess the work facets predicting the overall single-item job satisfaction measure among resident doctors. Materials and Methods: This descriptive study was conducted from August to October 2018 among 195 resident doctors. The survey instrument, i.e. the Min...
متن کاملA Comparison of the Facets of Mindfulness Among Patients With Major Depression, Social Anxiety Disorder and Healthy Individuals
Objective: There are well-established benefits of mindfulness in clinical settings, but the different roles of mindfulness facets in each disorder yet remain unclear. The purpose of the current study was to investigate between-group comparisons of the facets of mindfulness among patients with Major Depression Disorder (MDD), Social Anxiety Disorder (SAD) and healthy individuals. Methods: The p...
متن کامل